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HOW SHOULD ONE DEFINE ENTROPY PRODUCTION 
FOR NONEQUILIBRIUM QUANTUM SPIN SYSTEMS? 



by David Ruelle*. 



^ ! Abstract. This paper discusses entropy production in nonequi- 

^ I librium steady states for infinite quantum spin systems. Rigor- 

ous results have been obtained recently in this area, but a phys- 
ical discussion shows that some questions of principle remain to 
be clarified. 
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1. Introduction. 

Recent papers by Ruelle [4] , [5] , and Jaksic and Pillet [3] have discussed tiie nonequilib- 
rium statistical mechanics of infinite quantum spin systems, and in particular the positivity 
of entropy production. Mathematically, these papers are based on the treasure of results 
accumulated in the two volumes of Operator algebras and quantum statistical mechanics 
by Bratteli and Robinson [2] . In particular the concepts of relative modular operator and 
relative entropy, developed by Huzihiro Araki [1], turn out to play an essential role (see 
[3]). Clearly, the current surge of activity in nonequilibrium statistical mechanics is going 
to make more demands on operator algebras, and on the basic structural facts discovered 
about these algebras by Tomita, Takesaki, and Araki. The present paper is however less 
concerned with mathematics than with the physical question of how to define entropy 
production. We shall try to find out what is likely to be true or not true in this area, and 
therefore what are the theorems that one should attempt at proving. 

2. A formula for the entropy production in a finite system. 

In this section we consider a finite system described by a density matrix -0 on a 
finite-dimensional Hilbert space Ti. The (von Neumann) entropy associated with if) is 

S{il)) = -TrV'logV^ 

In the presence of a time evolution defined by unitary operators U{t) on Ti we may define 

^{t) = U{t)^U{-t) 

It is clear and well known that the entropy S{tl){t)) is independent of t: there is no entropy 
production in this setup. To understand entropy production we have to think of a large 
system (the universe) of which we observe a small part. By virtue of the time evolution, 
there are correlations between the state of the small system, and parts of the large system 
that are more and more remote. After a while these correlations are forgotten, or equiva- 
lently entropy is created. This is basically the way entropy production was understood by 
Boltzmann. 

We shall follow this way of thinking, and consider that our system is composed of 
several subsystems labelled by an index a = 0,1,... Corresponingly H = ®a>o^a7 we 
assume that the U{t) form a one-paramameter group of unitary transformations of 7i, 
with U{t) = e-'^K 

We can now define a density matrix ^a(^) on Tia as a partial trace: 

^„(t) = Tr^^Xt) 

where 7i\a — ®h^al^b- The entropies 

Sa{t) = -TrnAa{t)\ogMt) 
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may depend on t, and we define the (rate of) entropy production e = e(t) as 

a>0 a>0 

This is the rate of change of entropy associated with the decomposition of the system 
described by ilj{t) into the subsystems described by ipa{t)j a>0. 

Note that by the subbaditivity of the entropy 

J2Sa{t)-S{i;{t))>0 

a>0 

This positive quantity may be viewed as the information lost about the state 'i(j{t) of the 
system when we cut it into the subsystems labelled by a = 0, 1, ... In the large system limit 
where correlations move away and disappear at infinity, we expect X]a>o '^ait) ~S{'i(j{t)) to 
be an increasing function of t, so that e > (at least in the average). But for the moment 
we consider finite systems, i.e., we keep Ti. finite dimensional, and we look more carefully 
at the expression for the entropy production. 

Let us write 

a>0 



where 



Ha = l\a ® Ha 



and l\a is the unit operator on 7i\a. (Note that that the choice of h, Ha is not unique, 
one may in particular take h = H and all Ha = 0). Then, to first order in dt, 

il){t + dt) = e-^^'^*^(t)e^^^* = ^(t) - i dt[H, ip{t)] = ^{t) - i dt[J2 Ha + h, ^{t)] 

a>0 

hence 

Mt + dt) = tlJa{t) - i dt[Ha, Mt)] - i dtTrn^^ [h, V^(t)] 

Therefore, assuming that ip{t) is invertible so that the log is well defined, 

Sa{t + dt) = -Tr n^ijait + dt) logV;„(t + dt) 

— ai + a2 

where 

ai = -TvH^^/jait) log (Mt) - i dt[Ha, M^)] - « dtTvn^^ [h, V'(t)]) 

= -TTn^ija{t)log^a{t)+idtTTnAHa,Mt)]+idtTrn^TTn^^[h,ij{t)] 

= -TtH^Mt)'^ogiPa{t) 
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a2 = idmnS[Ha,i^a{t)]+^rn^SKij{t)])\ogiJa{t) 

= -idmn{^it)[h, l\a ® logV'a(t)]) 

Therefore 

Sa{t + dt) - Sait) = -idtTrn{Ht)[h, l\a ® logV'a(t)]) (1) 

e = -iY, T^Hii^it) [h, l\a ® log^ait)]) 

a>0 

and finally 

e = -iTrn{ij{t)[h,log®a>oMt)]) (2) 

Note that we may in (1) and (2) replace h by the total Hamiltonian H (take all Ha = 0): 

e = ~iTTnWt)[H, log<»a>oMt)]) 

3. The large system limit. 

We shall be interested in the limit of a large system. More precisely, the subsystem 
Rq = "E corresponding to a = will remain small, but it will interact with reservoirs 
i?i, i?2, • • •, which will become large (there is no direct interaction between the reservoirs). 
We shall be interested in the case where there are at least two large reservoirs (in the case 
of only one large reservoir i?i, we expect that the small system E will get in equilibrium 
with Ri if we wait long enough - this is the situation of approach to equilibrium) . We think 
of the reservoirs i?i, i?2, • • • as having different inverse temperatures /Si, (32, ■ ■ ■ Of course, 
putting the reservoirs in contact with the small system E will produce a flow of heat, so 
that the temperature in the reservoirs will not remain uniform, in particular the entropy 
production e defined by the large system limit of (2) might depend on where the boundary 
between the small system and the reservoirs is put. [It is also possible that it does not 
since, physically, entropy production depends on information disappearing at infinity on 
different sides of some separating surfaces, and the exact position of these surfaces may not 
be important] . In any case we are interested in a double limit where first the reservoirs are 
allowed to become infinite and then, perhaps, the boundaries between the small system and 
the reservoirs are allowed to move to infinity. This double limit is more or less imposed by 
physics, but seems hard to analyze mathematically. Note for example that we expect the 
entropy — Tr('?/) log (S)a>o'^a) + constant to diverge in a large system limit where it becomes 
time independent while its time derivative tends to a nonzero constant e. 

We shall try to argue that in the double limit discussed above, (2) becomes the stan- 
dard thermodynamic relation between the heat fluxes and the temperatures of the reser- 
voirs, but we shall not be able to give a proof of this fact. Basically, our difficulty is to 
make sense of the limit of log ^a>o'^a or [h, log(8)a>o'?/'a]- 

4. Infinite systems. 

In order to be able to discuss a small system E coupled with actually infinite reservoirs 
Ra with a > 0, we shall now introduce more structure into the problem. Let L be countably 



infinite, and Tix be a finite dimensional Hilbert space for eadi x & L. We let L be tfie 
disjoint union L = Ua>oRaj wfiere i?o = S is finite and tlie Ra witfi a > are infinite. 
Cfioosing A finite sucfi tfiat E C A C L, we may define Tia — Ti-Aa = ^xeAnfla^x, 
7i = Ha = ®x6a'^x, and study tfie finite system defined by a density matrix ilj{t) = i(^A{t) 
on Ha and a (self-adjoint) Hamiltonian H = Ha on Ha- 

For finite X C L let Ax be the C*-algebra of operators on Hx = ®xexHx- HY (Z X 
we may identify Ay with a subalgebra of Ax hj B \-^ B® lx\y , and define the quasilocal 
C*-algebra A corresponding to L as the norm closure of UxAx- We can then introduce a 
Hamiltonian for the infinite system L as the formal expression 

X<ZL 

where the sum is over finite subsets X of L, and ^{X) is self-adjoint G Ax- The finite 
system Hamiltonian is then defined by* 

H = Ht=Y, $(X) 

XcA 

The infinite system limit consists now in letting A tend to infinity in a suitable way, 
which we shall not discuss (but A should eventually contain any given finite set). We may 
assume that the density matrices ipAif) tend to a time independent state p on ^ when 
A — > L in the sense that 

Trn^ijA{t)A -^ p{A) if AeAx 

for finite X <Z L. We want to take for p not just a time invariant state, but one which 
qualifies as nonequilibrium steady state (so that in particular, if the entropy production 
can be defined, it is not negative). We shall discuss nonequilibrium steady states below. 

Of the quantities occuring in (1) and (2) we see that we can now replace Tr->^(?/^(t) • • •) 
by p(- ■ •)• Foi^ finite range interactions, /i is a well defined element of A and independent 
of A for sufficiently large A. The operator H is, in the limit of infinite A given formally by 
H'l as defined above. 

It is however not clear what to do with the limit of log®a>oV^a(^)- One idea would be 
to assume that 

logV'A(t) + CAlA ^ - ^ ^(X) 

XCL 

where the ca are constants and the right hand side is (up to sign) a formal sum of self- 
adjoint elements '^{X) G Ax for finite X <Z L. But such an Ansatz confiicts with the notion 
that \ogil)a{t) for a reservoir has long distance correlations, i.e., very large or infinite sets 
X should be important in the the formula displayed above. In conclusion, we believe, for 



* This may be modified (for instance by boundary terms) provided formally Ha -^ Hi 
when A tends to L. 



physical reasons that the infinite system hmit of the entropy production makes sense, but 
we cannot prove this fact. 

5. The thermodynamic formula for the entropy production. 

At this point we have come to an expression of e as limit when A tend to infinity (or 

A ^ L) of 

-iTr(/9A[i^A,log®a>0^a]) = iTr{[Hf , pA]log (»a>oi^a) 

Since p is invariant under the time evolution defined by H^, we have p{[Hf^,A] = if ^4 
belongs to a local algebra and A is sufficiently large. Therefore, Tr{[Hf^, p\\A) vanishes 
if A is localized well inside A, and is nonzero only for A localized near the boundary of 
A. In other words, in computing e we may ignore local terms from log ^a>o'>Pa and pay 
attention only to contributions from far away, at the boundary of A. An obvious guess is 
then to replace ipa by the equilibrium state at temperature /Sa in /?„, obtaining now e as 
limit when A — > L of 

a a 

Note that limA^L ^[-f^Ai -^Anit ] i^ ^ ^^^^ defined operator localized near the surface of 
the small system E, it represents the rate of transfer of energy to the reservoir Ra and 
therefore for large enough A 

e = p{J2MHA,HAnRj) (3) 

a 

In fact (3) is the usual thermodynamic expression of the entropy production in terms of 
heat fiuxes. Note that we may ignore the term with a — since the fiuxes to the small 
system add up to in a stationary state. 

We shall from now on proceed with the formula (3) for the entropy production, but 
remember that its relation with (2) has not been satisfactorily established. 

6. Nonequilibrium steady states (NESS). 

The definition of nonequilibrium steady states (NESS) should choose a direction of 
time, i.e., distinguish between the past and the future. Otherwise one cannot hope to prove 
that the entropy production e has a definite sign. One must also impose the asymptotic 
temperatures /3f ^, /3^^, . . . in the reservoirs i?i, i?2, • • • We assume that the interaction $ 
determines a one-parameter group (a*) of automorphisms of A, defining the time evolution 
of our system (see [2]). Let ai,a2, . ■ .he equilibrium states at inverse temperature /3i, P2, ■ ■ ■ 
for the reservoirs Ri, R2, . ■ . and oq any state for the small system T, — Rq. Assuming the 
existence for each A E A of a limit 



lim{®a>o(^a){a'A)=p{A) (4) 



defines a state p which one can certainly call a NESS. One can prove the existence of the 
limits (4) under strong conditions of asymptotic abelianness in time of the evolution (a*) 
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and also of the "uncoupled" evolutions («*). This was the point of view adopted in [4]. 
It has the advantage of leading to strong results like linear response formulae, but the 
disadvantage that the assumed asymptotic abelianness can practically never be verified. 
Progress in understanding nonequilibrium quantum spin systems will probably depend on 
a better understanding of the asymptotic abelianness conditions in question. 

It is however possible to obtain some results without unverifiable assumptions by 
considering limit points for T ^ oo of 

1 r 

- / dt{a'y{®a>o(Ja) (5) 

^ Jo 

in the weal dual of A. Such limit points p always exist (by w* -compactness of the set of 
states) and they are invariant under time evolution. The limit points p are good candidates 
to represent nonequilibrium steady states. In fact, it has been proved in [5], and more 
generally in [3] that the entropy production e defined by (3) is > for such states. [The 
reason is basically that the commutator in (3) is a derivative, which combines with the 
integral in (5) to produce a manageable expression]. 

If one assumes that the a^ (a > 0) are extremal KMS states and that (a*) is asymp- 
totically abelian one can show (see [5]) that the definition of the NESS as limit points of 
(5) does not depend on where the boundaries between the small system E and the reser- 
voirs Ra (a > 0) are placed. This is of course quite desirable. Asymptotic abelianness 
of (a*) also ensures that the NESS have a unique ergodic decomposition. So, even with 
the definition of NESS based on (5), questions of asymptotic abelianness seem to appear 
unavoidably. This is natural because if our system is composed of subsystems that do not 
interact (say the small system does not interact with the reservoirs, we violate asymptotic 
abelianness, and have an uninteresting theory. 

We have said nothing of the geometry of the reservoirs Ra (a > 0), but consideration of 
the macroscopic limit shows that (if they are pieces of regular lattices Z*^) their dimension 
d must be > 3. Indeed in the macroscopic limit, a NESS corresponds to a temperature 
field T satisfying AT = (say), and tending to limits (3~^ in the various reservoirs. In 
view of properties of harmonic functions this cannot happen for d < 3. What will happen 
for <i < 3 is that the temperature will tend, as time goes to infinity, to a constant in any 
bounded region, the temperature gradient and heat fiux will tend to zero, and the NESS 
will reduce to a thermodynamic equilibrium state with e = 0. 

In conclusion we hope to have shown in this note that, on our way to understand- 
ing quantum nonequilibrium statistical mechanics, there remains not only problems of 
mathematics to solve but also questions of physics to clarify. 
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